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ABSTRACT 



The purpose of this thesis was to apply computer compatible 
decision techniques to the problem of selecting a recipient for 
the Rear Admiral John J. Shieffelin Award for Excellence in 
Teaching at the Naval Postgraduate School. 

These computerized techniques were used to analyze the 
data from the ballots. The balloting process is described and 
computer programs are presented. Special studies were made 
using Kendell's coefficient of concordance. Their purpose was 
to investigate the issue of whether students and alumni rank 
faculty members in the same way. In addition the ranking of 
faculty members across years was studied. The results of this 
part of the study was that, on a statistical basis, it can be 
stated that the student and alumni ratings of faculty are 
similar and faculty rankings have been stable over the three 
years the award has been presented. 
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I. INTRODUCTION 



In this paper the history of the Shieffelin Award for 
Excellence in Teaching at the Naval Postgraduate School is 
discussed and the process involved in selecting the winner 
is explained. This process of selecting the outstanding 
teacher consisted of design and distribution of ballots, 
validation of ballots, collection of data, and computerized 
techniques used to analyze data. These techniques are ex- 
plained and the results are examined later in this thesis. 

Two statistical studies were conducted. The first was 
to determine if students and alumni within this years 1972 
voting population ranked teachers in a similar manner. The 
second study was made to determine if the ranking of teachers 
(by students) this year was consistent with the ranking of 
teachers (by students) in all previous years. 
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II . THE COMMITTEE 



The Award, for Excellence in Teaching was established in 
May 1969 by Rear Admiral Robert W. McNitt, USN, and awarded 
for the first time in June of 1970. At the time that the 
award was established a faculty committee was formed. The 
objective of this committee was to select a recipient for 
the outstanding teaching award to be presented each year 
during the June graduation exercise. 

The Superintendent of the Naval Postgraduate School, 

Rear Admiral A. S. Goodfellow, USN, on 1 March 1972 sent a 
letter to the Alumni members of the 1970 graduation classes. 
Part of this letter stated ... "This June an award for excel- 
lence in teaching for the third time will be given to a member 
of our faculty, civilian or military. This award is now known 
as the Rear Admiral John J. Shieffelin Award, and was made 
possible through a grant to the Naval Postgraduate School 
Foundation. Previous winners of the award are Professor 
John N. Dyer of the Department of Physics and Professor 
Eugene C. Haderlie of the Department of Oceanography. The 
recipient is determined each year through a careful poll taken 
among alumni, students, and faculty." 

This years recipient of the award again was selected by a 
committee of seven faculty members. The committee was com- 
posed of a Chairman, Professor D. B. Hoisington; a Secretary, 
Associate Professor P. J. Renard, and five other members, 
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Associate Professors R. H. Stolfi, C. R. Jones, Professor 
J. N. Dyer, and Assistant Professors G. J. Hokenson and G. L. 
Musgrave . 

The members of this committee are selected to provide a 
wide variety of backgrounds and curricula. Pour persons 
leave the committee each year and are replaced by four new 
members, thus, engendering new ideas and concepts in the 
selection process while retaining a core of persons familiar 
with the existing system. 

Again this year, the committee decided to retain the 
same philosophical outlook concerning the nature of excellence 
in teaching along with how excellence in teaching should be 
reliably identified and evaluated. The interested reader 
will find this outlook in a previous Naval Postgraduate 
School thesis.'*' To set the groundwork for this paper certain 
guidelines for the selection process will be discussed. These 
guidelines are as follows: 

1. All faculty with the exception of the Department 
Chairman, Administrators, members of the selection 
committee, and previous winners are eligible to 
receive the award. 

2. The voting population includes all current students, 
faculty, and Curricular Officers. Also included in 
this is the group of Naval Officers which graduated in 
1970. 

3. Participation in the poll is entirely voluntary and 
no one is required to sign his ballot. 



^Robert V/. Geary, "The First Annual Award for Excellence 
in Teaching, A Study of Procedure and Analysis of Data" 
(unpublished Master's thesis, U. S. Naval Postgraduate School, 
Monterey, California, 1970), p. 10. 
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Care and discretion are used to ensure no ranking of 
candidates is published. 

5. For the ballot to be valid the voter must indicate that 
he is acquainted with at least five members on the 
candidate list. 

6. The voter is cautioned not to vote on the basis of 
personality or popularity but on teaching ability and 
performance . 

In order to maintain objectivity among the selection 
committee it was determined that an individual from outside 
the faculty would handle the ballots, collate the data and 
submit the results to the selection committee. 

Only after the committee selected the nominee for this 
years award was his name made known to the selection committee. 
The nominee's name was then submitted to Rear Admiral A. S. 
Goodfellow for final approval, and remained a secret to all 
others until the award was presented at the 'June graduation. 



9 



III. THE BALLOT 



A . FORMAT 

An instruction sheet was attached to the front of the 

ballot to explain the purpose of the award, give instructions 

on how to complete the ballot, and explain the requirements 

2 

for validating the ballot. 

The ballot itself was composed of four parts. Part A was 
a Data Processing aid to help in the analysis of the voter 
population characteristics. The voter was asked to identify 
his voter category. Rank, Branch of Service, and Curricular 
area if military; if Civilian his academic rank and department 
were to be circled. 

Part B included three blanks to be used in indicating 
first, second, and third choices for the award using the four 
digit identification number in Part C. 

Part C of the ballot identified all eligible faculty 
members from which each voter could select his first, second, 
and third choices. Each eligible faculty member was listed 
in alphabetical order under the heading of his department. 

The voter was asked to circle a four digit identification 
number of all those faculty members with whom he considered 
himself to be reasonably well acquainted in an academic 
capacity. 



2 

A sample ballot and instruction sheet are included in 
Appendix A. 
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The last portion of the ballot, Part D, was to be used 
to comment on the reasons for his selection. This portion 
was not mandatory, but was considered beneficial in the final 
selection processes. 

B. THE BALLOTING PROCESS 

Ballots were distributed to students by utilizing the 
student mail center (SMC). The alumni group selected to 
participate in this years voting were the Naval Officers who 
graduated in calendar year 1970. Their names and addresses 
were taken from a data tape maintained in the computer 
facility . 

As an aid for addressing alumni ballots, a computer 
program w as written which can be used in the future. The 
address tape can now be sorted by commands so that all 
graduates with similar addresses will be listed. On the 
basis of this years alumni sample this should mean a savings 
of about 2 h% in over all look up time since this process is 
done by hand the saving in time is important. 

Faculty ballots were distributed by the members of the 
committee to the appropriate faculty mail center locations. 

After voting, the completed ballot was placed in the 
attached envelope addressed to the Superintendent of the 
Naval Postgraduate School and mailed to the committee member 
in charge. The envelopes were coded 55 BAL to help route 
them to the person assembling the data. 
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C. BALLOT VALIDATION 



1 . Assembling the Data 

As the ballots were returned the validation process 
for each ballot began. Each envelope contained an area for 
the voters signature, this was considered important to ensure 
that only one ballot was received from each voter. The 
envelopes and cover sheets were then discarded. 

The validation process encompassed counting to ensure 
that Part C of the ballot had at least five identification 
numbers circled and the nominations for first, second, and 
third place were valid nominations. If less than five identi- 
fication numbers were circled in Part C the ballot was 
considered void and eliminated from the voting process. 

The committee decided that when a voter gave all 
three votes to the same teacher that the second and third 
place choices would be nullified. Each ballot was then given 
a four digit identification number so that specific data could 
be retrieved at a later time. 

Of 1,319 ballots returned, 1^8 were deemed void 
because a population of five persons was not specified by the 
voter, and nine were returned too late to be processed. In 
last years voting ballots were deemed void because of write-in 
nominations of ineligible faculty members; however, this year’s 
committee decided to process the ballot as valid if the other 
two votes were valid. 

The number of void ballots has in the past been attri- 
buted to the large number of first quarter students; however. 
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of the 148 void ballots, 5 failed to identify their voter 
category, 79 were students, 40 were alumni, 23 were faculty, 
and 1 was a curricular officer, thus 37 % of all void ballots 
were from the non-student population and could not be attri- 
buted to first quarter students. 
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IV. STATISTICAL ANALYSIS 



A. TRANSFERRING DATA TO COMPUTER TAPE 

After the above validation process was completed, the 

information from each ballot was transferred to punched 

cards. These data cards were then processed by a COBOL 

"2 

computer program called "TRANSFER" which: 

1. Checked for key punch errors. 

2. Checked for a population of at least five teachers. 

3. Gave a printed output of all ballots which contained 
errors . 

4. Transferred the data from ballots which contained no 
errors to a magnetic computer tape. 

The techniques used by "TRANSFER" to check for errors was 

based on the four digit -identification number assigned to 

each teacher on the ballot. The first three digits of each 

identification number assigned to each teacher on the ballot 

formed a vector, N, which when multiplied by a fixed weighing 

vector, S, formed an inner product. The last digit of this 

inner product formed the fourth digit of the identification 

number . 

For example, take a teacher with an identification number 
of 2934. The digits 293 identify the teacher, while the last 
digit "4" is the result of the last digit in the inner product. 

3 

(293) 5 = 6+45+3 = 54 

1 



^A listing of "TRANSFER" is included in Appendix B. 



Thus each number can be checked for correctness using an 
error detection system where the inner product is computed and 
compared against the fourth digit of the identification number. 
Any number which was typed in error, or any nomination which 
the voter may have copied incorrectly from the ballot would 
be detected. Only after each number on each ballot was 
checked would that ballot be transferred to the magnetic tape. 
Anytime a number was in error a message would be printed 
giving the ballot number and the cause for the rejection. 
Corrections would be made to the appropriate data cards and 
"TRANSFER" would be run again until all valid ballots were 
recorded on the magnetic tape. 



B. POPULATION CHARACTERISTICS 

With all valid ballots recorded on tape it w as possible 
to abstract data from this tape which would give a breakdown 
of the characteristics of the voting population. One of the 
major goals of this years committee was to increase voter 
response, to the maximum possible extent. The percentage 
of response was determined for each voter category for both 
this year 1972 and last year 1971. Table I. below lists the 
breakdown of this years ballots. 





Table I. Ballot Breakdown 






Voter Category 


No. Eligible 


No. Valid % 


Valid 


% Increase 
Over Pre- 




Voters 


Ballots From Eligible 


vious Yr . 


Student 


1700 


702 


41.3 


(12.8) 


Alumni 


580 


350 


6l . 7 


14.8 


Faculty 


308 


106 


34.4 


0.3 


Curricular Officer 16 


5 


31-3 


0.0 


Alumni & Students 2280 


1052 


46.1 


(6.4) 



() Indicate a decrease 
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The last column compares the difference in the percent of 
valid ballots returned from the eligible population for this 
year and last. The table shows that there was no change in 
the percentage of curricular officers voting, while the 
percentage of students voting dropped, and the percentage of 
alumni and faculty voting increased. 

C. CLOSER OBSERVATIONS 

Further information concerning the voter population is 
contained in the following set of tables. Table II presents 
a breakdown of faculty voters by curricular department and 
academic rank. The columns indicate the different ranks and 
rows indicate academic department. By scanning the Jth 
column and Ith row, a determination of the number of valid 
ballots from faculty of I department and of J rank can be 
determined . 

Tables III, IV, and V give a breakdown of military voters 
by Branch of Service, Rank, and Voter Category. Table V 
also includes civilian students and alumnus which attended 
the defense management school. The 21 in this column represents 
5 civilian students and 16 civilians. The students votes are 
included in the percentage of student votes for that curricular 
area. In each table the Ith row gives the curricular area and 
Jth column gives either the Branch of Service, Rank, or Voter 
Category. 
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TABLE II. FACULTY 



Rank 

Department 


Instructor 


Assistant 

Professor 


Associate 

Professor 


Professor 


Total 

Voted 


Number 

Enrolled 


Aeronautics 


- 


4 


5 


4 


13 


22 


Aviation Safety 


2 




1 


- 


3 


6 


Business Administra- 
tion & Economics 


1 


2 


1 


2 


6 


31 


Electronic 

Engineering 




2 


3 


6 


11 


46 


Government 
& Humanities 


3 


- 


1 


1 


5 


12 


Material Science 
& Chemistry 


- 


- 


2 


1 


3 


12 


Math 


2 


2 


2 


2 


8 


41 


Mechanical 

Engineering 


1 


1 


1 


3 


6 


13 


Meteorology 


1 


5 




1 


7 


13 


Oceanography 


1 


2 


1 


2 


6 


15 


Operations 

Analysis 


3 


3 


7 


2 


15 


46 


Physics 


- 


3 


2 


7 


12 


30 


Navy Management 
Systems Center 


2 


3 


3 


3 


11 


21 


Totals 


16 


27 


29 


3^ 


106 


308 
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TABLE III. BRANCH OF SERVICE 



CURRICULAR 

AREA 


NAVY 


ARMY 


MARINE 


COAST 

GUARD 


AIR 

FORCE 


FOREIGN 


30 

Operations 

Analysis 


129 


24 


6 


0 


0 


6 


31 

Aeronautical 

Engineering 


62 


0 


0 


0 


0 


0 


32 

Electronics & 
Communication 


91 


0 


0 


0 


0 


1 


33 

Ordnance 


46 


6 


0 


0 


0 


1 


3^ 

Naval 

Engineering 


49 


0 


0 


0 


0 


3 


35 

Environmental 

Science 


93 


0 


0 


1 


0 


3 


36 

Management & 
Computer Science 


250 


0 


11 


3 


0 


1 


37 

Engineering 

Science 


22 


0 


0 


0 


0 


1 


o Q 

^ Baccalaureate 


164 


0 


0 


0 


0 


0 


39 

Defense 

Management 


16 


9 


7 


0 


0 


7 


TOTALS 


921 


39 


.24 


4 


0 


23 
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TABLE IV. RANK 



CURRICULAR 

AREA 


01 


02 


03 


04 


05 


06 


30 

Operations 

Analysis 


10 


7 


90 


52 


5 


1 


31 

Aeronautical 

Engineering 


12 


4 


29 ' 


13 




0 


32 

Electronics & 
Communication 


15 


3 


52 


33 


1 


3 


33 

Ordnance 


9 


3 


21 


17 


2 


1 


34 

Naval 

Engineering 


9 


3 


22 


16 


0 


2 


35 

Environmental 

Science 


18 


. 3 


42 


30 


4 


0 


36 

Management & 
Computer Science 


38 


7 


67 


109 


42 


2 


37 

Engineering 

Science 


0 


4 


12 


6 


0 


1 


38 

Baccalaureate 


32 


1 


43 


54 


33 


0 


39 

Defense 

Management 


2 


1 


8 


6 


14 


8 


TOTALS 


147 


36 


386 


336 


105 


18 
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TABLE V. VOTER CATEGORY 



CURRICULAR 

AREA 


STUDENTS 


ALUMNI 


CURRIC- 

ULAR 

OFFICERS 


Enrollment 


Votes 


Percentage 


30 

Operations 

Analysis 


276 


139 


50.4 


26 


2 


31 

Aeronautical 

Engineering 


131 


47 


35.9 


15 


0 


32 

Electronics •& 
Communication 


186 


86 


46.3 


21 


0 


33 

Ordnance 


145 


41 


28.3 


12 


1 


3^ 

Naval 

Engineering 


92 


39 


42.4 


13 


1 


35 

Environmental 

Science 


128 


70 


55.6 


27 


_ 0 _ 


36 

Management & 
Computer Scien< 


339 

2Q 


140 


41.0 


125 


1 


37 

Engineering 

Science 


76 


21 


27.6 


2 


0 


38 

Baccalaureate 


295 


98 


33.2 


65 


0 


39 

Defense 

Management 


32 


21 


65.6 


51 


0 


TOTALS 


1700 


702 


41.3 


357 


5 
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D. DISTRIBUTION OP M j _ 

A second COBOL computer program called "PROFSORT" was 
run. Its purpose was to reorganize the data from "TRANSFER" 
into records for each professor which is identified on each 
ballot. This new record-file is organized by ascending 
professor number. is defined as the number of eligible 

faculty members known by the ith voter. 

Table VI presents a frequency table of M ± . The mean 
number of faculty members known by the voters was 17-7 and 
the standard deviation was 11.6. 



Table VI. FREQUENCY TABLE OF M, 



CELL 


FREQU] 


5- 9 


204 


10-14 


321 


15-19 


246 


20-24 


166 


25-29 


124 


30-34 


47 


35-39 


17 


40-44 


10 


45-49 


6 


50-54 


4 


55-59 


1 


60-64 


2 


65-69 


2 


70-74 


1 


75-79 


1 


80-84 


0 


85-89 


0 


90-94 


1 



% listing of "PROFSORT" is included in Appendix B. 



21 



E. DISTRIBUTION OP N R 

A third COBOL computer program called "SCORSORT"" 5 used 
the sorted data produced by "PROFSORT" as input. The 
"SCORSORT" program determined the distribution of N^, the 
number of voters who knew the Kth professor. Table VII is a 
frequency table of and figure 1 presents a histogram of 
N^. The mean number of voters who knew teacher K was 70.5 
with a standard deviation of 43.4. An interesting fact 
shown by the frequency table of N^ is that one professor 
was known by 274 voters. 



Table VII. FREQUENCY TABLE OF N v 



CELL 
1 - 24 
26- 50 
51- 75 
76-100 
101-125 
126-150 
151-175 
176-200 
201-225 
226-250 
251-275 

5 A listing of "SCORSORT" 



FREQUENCY 

19 

75 

99 

40 

33 

16 

6 

2 

0 

1 

1 

is included in Appendix B. 
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Figure 1. HISTOGRAM OF N R 



Another important result determined by "SCORSORT" was 
the performance of each teacher, T^. A printout of the Kth 
teacher's score, S^, is given. is determined in "SCORSORT" 

as follows: 

X 1K = Tota l number of first place votes for T^. 

^2K = ^ ota ^ number of second place votes for T^. 

= Total number of third place votes for T^. 

^'1K > ^2K 5 X 3K were eac ^ divided by N^, the number of 
persons who identified T^ in Part C of the ballot, yielding 
a vector V„. 
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Vr was multiplied by a weighting vector V/, where 
W = (4,2,1), and the product was the score, Sr, for teacher K. 

" Z K = (X 1K * W) + (X 2K ' W) + (X 3K * 



S K " N 



Table VIII presents a summary of the "SCORSORT" printout 
showing K, Sr, Nr, Zr, X-^r, X 2 r, and X^r respectively. 



P. DOMINANCE 

The fourth COBOL computer program called "DOMINANCE"^ 
used the results generated by "SCORSORT" for input data. This 
data included 

X IK = num ^ er °f 1 th place votes received by teacher K. 

Nr = Number of voters who knew Tr. 

V IK = X IK^K = fraction °f 1th Place votes awarded Tr by 

the population of voters that knew him. 

The purpose of this program was to reduce the number of 
eligible recipients by two methods, (1) absolute dominance and 
(2) complete dominance. 

1 . Background 

If Sr, the score of teacher K is represented by 
3 

Sr = I ^I* V IK where W = (W^, , W^) is a 

weighing vector such that 

\ 

W x > W 2 > W 3 > 0. (1) 

6 A listing of "DOMINANCE" is included in Appendix B. 
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K 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

3 ^ 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 



X 3K 

8 

5 

3 

5 

8 

13 

3 

14 

18 

11 

12 

4 

6 

2 

8 

2 

5 

9 

4 

7 

2 

9 

1 

2 

7 

4 

8 

7 

3 

6 

10 

3 

9 

7 

4 

24 

9 

12 

3 

8 

11 

7 

1 

6 



S K 



1.92157 

1.77586 

1.75862 

1.57353 

1.50000 

1.47222 

1.43478 

1.35238 

1.30994 

1.26446 

1.24234 

1.24234 

1.17073 

1.13043 

1.11321 

1.10714 

1.10606 

1.08824 

1.05882 

1.05761 

1.05128 

1.00000 

1.00000 

0.94737 

0.90805 

0.90196 

0.89655 

0.89535 

0.89130 

0.88889 

0.88722 

0.87342 

0.86364 

0.84946 

0.83077 

0.82553 

0.81731 

0.81553 

0.81132 

0.80000 

0.76860 

0.75781 

0.75000 

0.74138 



TABLE VIII. SCORSORT SUMMARY 



51 


98 


58 


103 


29 


51 


68 


107 


68 


102 


108 


159 


69 


99 


105 


142 


171 


224 


121 


153 


74 


92 


74 


92 


41 


48 


23 


26 


106 


118 


56 


62 


66 


73 


102 


111 


34 • 


36 


52 


55 


78 


82 


83 


■ 83 


27 


27 


57 


54 


87 


79 


51 


46 


116 


104 


86 


77 


46 


41 


45 


40 


133 


118 


79 


69 


66 


57 


93 


79 


65 


54 


235 


194 


104 


85 


103 


84 


53 


43 


55 


44 


121 


93 


128 


97 


28 


21 


116 


86 



X 1K 


X 

OJ 

X 


17 


11 


23 


3 


9 


6 


20 


11 


17 


13 


30 


13 


19 


10 


24 


16 


36 


31 


24 


23 


14 


12 


21 


2 


7 


7 


5 


2 


20 


15 


12 


6 


12 


10 


18 


15 


6 


4 


9 


6 


17 


6 


14 


9 


5 


3 


7 


12 


10 


16 


10 


1 


19 


10 


11 


13 


7 


5 


.6 


5 


22 


10 


15 


3 


10 


4 


12 


12 


10 


5 


32 


21 


15 


8 


12 


12 


7 


6 


6 


6 


12 


17 


16 


13 


3 


4 


16 


8 
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K 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 

61 

62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 

81 

82 

83 

84 

85 

86 

87 

88 



TABLE VIII. SCORSORT SUMMARY (Continued) 



S K 


n k 


' Z K 


X 1 K 


X 2 K 


X 3 K 


0.73333 


30 


22 


4 


2 


2 


0.72973 


74 


54 


5 


11 


12 


0.71233 


73 


52 


9 


5 


6 


0.63380 


71 


45 


10 


1 


3 


0.61165 


103 


63 


10 


9 


5 


0.60465 


129 


78 


9 


17 


8 


0.59302 


86 


51 


6 


12 


3 


0.58974 


39 


23 


4 


2 


3 


0.58108 


74 


43 


5 


10 


3 


0.57647 


85 


49 


8 


4 


9 


0.57377 


61 


35 


5 


6 


3 


0.56944 


72 


41 


5 


8 


5 


0.56140 


57 


32 


3 


8 


4 


0.56000 


75 


42 


6 


7 


4 


0.55932 


59 


33 


5 


5 


3 


0.55263 


38 


21 


4 


1 


3 


0.55245 


143 


79 


11 


12 


11 


0.54545 


22 


12 


2 


1 


2 


0.54015 


137 


74 


11 


11 


8 


0.53846 


26 


14 


2 


0 


6 


0.53030 


66 


35 


5 


6 


3 


0.52252 


111 


58 


6 


12 


10 


0.51923 


52 


27 


4 


3 


5 


0.51282 


117 


60 


8 


8 


12 


0.51220 


82 


42 


8 


4 


2 


0.50000 


164 


82 


12 


11 


12 


0.50000 


24 


12 


0 


5 


2 


0.49333 


75 


37 


3 


9 


7 


0.49180 


61 


30 


4 


6 


2 


0.48649 


74 


36 


6 


3 


6 


0.47423 


97 


46 


8 


4 


6 


0.47222 


36 


17 


1 


4 


5 


0.46575 


73 


34 


5 


5 


4 


0.46000 


50 


23 


4 


1 


5 


0.45652 


92 


42 


7 


4 


6 


0.45455 


121 


55 


4 


12 


15 


0.45455 


44 


20 


4 


2 


0 


0.45378 


119 


54 


6 


11 


8 


0.44828 


58 


26 


3 


6 


2 


0.44615 


130 


58 


6 


11 


11 


0.44262 


61 


27 


4 


3 


5 


0.42857 


21 


9 


1 


2 


1 


0.42553 


94 


40 


6 


4 


8 


0.42424 


66 


28 


4 


5 


2 
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89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 

100 

101 

102 

103 

104 

105 

106 

107 

108 

109 

110 

111 

112 

113 

114 

115 

116 

117 

118 

119 

120 

121 

122 

123 

124 

125 

126 

127 

128 

129 

130 

131 

132 



TABLE VIII. SCORSORT SUMMARY (Continued) 



S K 


n k 


Z K 


X 1 K 


X 

CVJ 

X 


X 3 K 


0.42169 


166 


70 


12 


5 


12 


0.41975 


81 


34 


4 


7 


4 


0.41667 


60 


25 


3 


3 


7 


0.41379 


87 


36 


5 


6 


4 


0.41071 


56 


23 


4 


3 


1 


0.40476 


42 


17 


2 


4 


1 


0.40299 


67 


27 


4 


4 


3 


0.40000 


65 


26 


5 


2 


2 


0.39726 


73 


29 


4 


4 


5 


0.39216 


51 


20 


1 


6 


4 


0.38562 


153 


59 


7 


10 


11 


0.38298 


47 


18 


3 


2 


2 


0.37931 


58 


22 


3 


3 


4 


0.37778 


90 


34 


1 


10 


10 


0.37705 


61 


23 


3 


3 


5 


0.37333 


75 


28 


5 


3 


2 


0.37255 


102 


38 


7 


3 


4 


0.36667 


30 


11 


2 


1 


1 


0.36585 


41 


15 


1 


4 


3 


0.36207 


58 


21 


1 


6 


5 


0.35556 


90 


32 


4 


5 


6 


0.35294 


17 


6 


1 


0 


2 


0.34211 ' 


38 


13 


3 


0 


1 


0.33594 


128 


43 


7 


6 


3 


0.33333 


51 


17 


1 


5 


3 


0.32632 


95 


31 


4 


6 


3 


0.32500 


40 


13 


1 


4 


1 


0.32468 


77 


25 


2 


6 


5 


0.31579 


19 


6 


0 


3 


0 


0.31373 


51 


16 


2 


3 


2 


0.31250 


48 


15 


2 


2 


3 


0.30769 


39 


12 


2 


1 


2 


0.30769 


39 


12 


2 


2 


0 


0.30645 


62 


19 


2 


3 


5 


0.30435 


115 


35 


7 


2 


3 


0.29921 


127 


38 


4 


7 


8 


0.29167 


24 


7 


1 


0 


3 


0.29141 


326 


95 


14 


13 


13 


0.28947 


38 


11 


1 


3 


1 


0.28571 


28 


8 


1 


2 


0 


0.28125 


160 


45 


1 


12 


17 


0.28090 


89 


25 


4 


2 


5 


0.27660 


47 


13 


2 


2 


1 


0.27586 


29 


8 


1 


1 


2 
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133 

13** 

135 

136 

137 

138 

139 

1*10 

1*11 

1*12 

1*13 

1 * 1*1 

1*15 

1*16 

1*17 

1*18 

149 

150 

151 

152 

153 

154 

155 

156 

157 

158 

159 

160 

l6l 

162 

163 

164 

165 

166 

167 

168 

169 

170 

171 

172 

173 

174 

175 

176 



TABLE VIII. SCORSORT SUMMARY (Continued) 



S K 


n k 


Z K 


X 1K 


X 2K 


X 3K 


0.27273 


44 


12 


1 


2 


4 


0.27027 


37 


10 


1 


2 


2 


0.26923 


52 


14 


3 


0 


2 


0.26667 


60 


16 


1 


3 


6 


0.26563 


64 


17 


2 


4 


1 


0.25641 


117 


30 


5 


3 


4 


0.25385 


130 


33 


5 . 


5 


3 


0.25352 


71 


18- 


3 


2 


6 


0.25287 


87 


22 


3 


2 


6 


0.25225 


111 


28 


5 


3 


2 


0.25000 


80 


20 


3 


2 


4 


0.25000 


36 


9 


1 


1 


3 


0.24528 


53 


13 


l 


4 


1 


0.24444 


45 


11 


1 


2 


3 


0.24138 


145 


35 


3 


8 


7 


0.23944 


71 


17 


1 


5 


3 


0.23894 


113 


27 


3 


2 


11 


0.237H 


97 


23 


3 


4 


3 


0.23404 


47 


11 


0 


3 


5 


0.22917 


96 


22 


2 


4 


6 


0.22807 


57 


13 


2 


1 


3 


0.22535 


71 


16 


3 


2 


0 


0.22222 


45 


10 


1 


3 


0 


0.22222 


45 


10 


0 


2 


6 


0.22059 


68 


15 


2 


3 


1 


0.21875 


64 


14 


1 


4 


2 


0.21667 


60 


13 


2 


2 


1 


0.21311 


61 


13 


1 


3 


3 


0.20690 


29 


6 


0 


2 


2 


0.20000 


45 


9 


2 


0 


1 


0.19512 


123 


24 


4 


2 


4 


0.19355 


93 


18 


1 


4 


6 


0.19048 


42 


8 


0 


3 


2 


0.18033 


61 


11 


1 


2 


3 


0.17778 


45 


8 


0 


4 


0 


0.17500 


40 


7 


1 


1 


1 


0.17355 


121 


21 


3 


4 


1 


0.17241 


58 


10 


2 


1 


0 


0.16867 


83 


14 


2 


2 


2 


0.16774 


155 


26 


2 


5 


8 


0.16667 


54 


9 


1 


2 


1 


0.16484 


91 


15 


2 


3 


1 


0.16129 


62 


10 


1 


2 


2 


0.15625 


32 


5 


0 


1 


3 
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177 

178 

179 

180 

181 

182 

183 

184 

185 

186 

187 

188 

189 

190 

191 

192 

193 

194 

195 

196 

197 

198 

199 

200 

201 

202 

203 

204 

205 

206 

207 

208 

209 

210 

211 

212 

213 

214 

215 

216 

217 

218 

219 

220 



TABLE VIII. SCORSORT SUMMARY (Continued) 



S K 


n k 


Z K 


X 1K 


C\J 

X 


X 3K 


0.15254 


59 


9 


1 


2 


1 


0.15217 


46 


7 


1 


1 


1 


0.14474 


76 


11 


1 


3 


1 


0.14362 


188 


27 


4 


3 


5 


0.14286 


14 


2 


0 


1 


0 


0.13725 


51 


7 


0 


2 


3 


0.12963 


54 


7 


1 


1 


1 


0.12500 


64 


8 


1 


2 


0 


0.12088 


91 


11 


0 


4 


3 


0.12000 


75 


9 


1 


2 


l 


0.11905 


42 


5 


0 


1 


3 


0.11765 


17 


2 


0 


1 


0 


0.11667 


60 


7 


1 


1 


1 


0.11570 


121 


14 


1 


3 


4 


0.11530 


26 


. 3 


0 


1 


1 


0.11511 


139 


16 


1 


3 


6 


0.11111 


63 


7 


0 


3 


1 


0.11111 


45 


5 


0 


2 


1 


0.10909 


110 


12 


1 


3 


2 


0.10811 


74 


8 


0 


3 


2 


0.10280 


107 


11 


0 


3 


5 


0.10169 


59 


6 


0 


2 


2 


0.10169 


59 


6 


1 


0 


2 


0.10000 


70 


7 


1 


1 


1 


0.10000 


40 


4 


1 


0 


0 


0.09804 


102 


10 


r 


2 


2 


0.09756 


41 


4 


0 


2 


0 


0.09459 


74 


7 


1 


0 


3 


0.09434 


53 


5 


1 


0 


1 


0.09346 


107 


10 


1 


2 


2 


0.09302 


43 


4 


1 


0 


0 


0.09091 


77 


7 


1 


1 


1 


0.09091 


55 


5 


1 


0 


1 


0.09091 


33 


3 


0 


1 


1 


0.09091 


33 


3 


0 


1 


1 


0.08889 


90 


8 


0 


3 


2 


0.08725 


149 


13 


1 


3 


3 


0.08571 


70 


6 


0 


2 


2 


0.08511 


47 


4 


1 


0 


0 


0.08475 


59 


5 


0 


2 


1 


0.08333 


12 


1 


0 


0 


1 


0.08235 


85 


7 


1 


0 


3 


0.07692 


39 


3 


0 


1 


1 


0.07692 


26 


2 


0 


1 


0 
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221 

222 

223 

224 

225 

226 

227 

228 

229 

230 

231 

232 

233 

23b 

235 

236 

237 

238 

239 

2bo 

2bi 

2b2 

2b3 

2bb 

245 

2b6 

247 

248 

2b9 

250 

251 

252 

253 

25*1 

255 

256 

257 

258 

259 

260 

261 

262 

263 

26*1 



TABLE 


VIII. 


SCORSORT 


SUMMARY 


(Continued ) 


s 


M 


z Tr 


X-, T , 






K 


K 


K 


IK 


2K 


3K 


0.07576 


66 


5 


0 


2 


1 


0.07500 


80 


6 


1 


1 


0 


0.07353 


68 


5 


1 


0 


1 


0.07333 


150 


11 


1 


3 


1 


0.06897 


58 


4 


0 


1 


2 


0.06667 


30 


2 


0 


0 


2 


0 . 06*110 


78 


5 


0 


2 


1 


0.06250 


32 


2 


0 


1 


0 


0.06250 


32 


2 


0 


0 


2 


0.06000 


50 


3 


0 


1 


1 


0.05556 


108 


6 


1 


0 


2 


0.05357 


56 


3 


0 


1 


1 


0.05172 


58 


3 


0 


1 


1 


0.04762 


105 


5 


1 


0 


1 


0.04545 


22 


1 


0 


0 


1 


0.04444 


90 


4 


1 


0 


0 


0.04324 


185 


8 


2 


0 


0 


0.04317 


139 


6 


1 


1 


0 


0.04167 


48 


2 


0 


0 


2 


0.03704 


54 


2 


0 


' 1 


0 


0.03676 


136 


5 


1 


0 


1 


0.03636 • 


55 


2 


0 


1 


0 


0.03614 


83 


3 


0 


1 


1 


0.03604 


111 


4 


0 


2 


0 


0.03390 


59 


2 


0 


1 


0 


0.03279 


61 


2 


0 


0 


2 


0.03261 


92 


3 


0 


1 


1 


0.02778 


36 


1 


0 


0 


1 


0.02703 


74 


2 


0 


0 


2 


0.02703 


37 


1 


0 


0 


1 


0.02632 


38 


1 


0 


0 


1 


0.02564 


39 


1 


0 


0 


1 


0.02326 


43 


1 


0 


0 


1 


0.01818 


55 


1 


0 


0 


1 


0.01786 


56 


1 


0 


0 


1 


0.01449 


69 


1 


0 


0 


1 


0.00990 


101 


1 


0 


0 


1 


0.00926 


108 


1 


0 


0 


1 


0.00714 


140 


1 


0 


0 


1 


0.00000 


100 


0 


0 


0 


0 


0.00000 


91 


0 


•0 


0 


0 


0.00000 


89 


0 


0 


0 


0 


0.00000 


85 


0 


0 


0 


0 


0.00000 


71 


0 


0 


0 


0 
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266 

267 

268 

269 

270 
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276 
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279 
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39 
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38 
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38 
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34 
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32 
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31 


0.00000 


29 
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27 
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26 
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26 
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23 
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22 
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22 
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14 
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SCORSORT SUMMARY (Continued) 



Z K 



Y Y Y 

IK 2K 3K 



0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

.0 

0 

0 

0 

0 

0 



0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 ' 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 
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000000000000000000000000000 



Expression (1) states that a first place vote should be 
weighted higher than a second place vote, which in turn should 
be weighted higher than a third place vote, and that all 
weights be greater than zero. 

A second set of restrictions on the weights logically 
would be that no two weights be the same or that 



/ W 1 < 1 


(2) 


/ W 2 < 1 


(3) 



therefore from (1), (2), and (3) we have 

o < w 2 /v / 1 < 1 

0 < w~/w 2 < 1 

Now letting (a^,b-j.) and (a 2 ,b 0 ) define a preferential region 
interior to the unit square then 

0 < a 1 < W 2 A r x < b, < 1 

0 K a 2 - w 3 /w 2 1 b 2 < 1 

The values 

a l = a 2 = 1/3 

bi = b 2 = 2/3 

were used as acceptable parameters based on a determination 
of the smallest and largest ratios acceptable for the three 
weight s . 
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2. Absolute Dominance 



If K and K' denote any two teachers, S K and S K ,' are 



their respective scores from "SCORSORT" then it is desired 
to find all values of W such that 



Then teacher K is absolutely dominant over teacher K' 



when > 0, 1=1, 2, 3, for then S K > S^, and 

teacher K' can be eliminated from the competition. 

3 . Complete Dominance 

The second form of dominance, complete dominance 
eliminates all teachers who in order to win must have a 
weighting system that violates > VJ^ . 



S„ > S„, . For all K ^ K 

— l\ 



therefore by substitution 




or 




From (5) 




or 





> 



The dominance relationship is determined by 



and since all values of and , are known. 

Letting Y = , X = and noting that 

0 <_ Y _< 1 and X >_ 1 then letting 



A 


f — 1 
> 

11 


" V 1K 


B 


C\J 

> 

1 

it 


^ V 2K 


C 


= V 

3K 


on 

> 

l 



and substituting into expression (5) we have Y 
which is the slope intercept form for a line. 



AX B 
C C 



Y 




Figure 2. DOMINANCE PLOT 

Figure 2 is a plot of Y vs X with the feasible region 
shown for the weights. Teacher K is completely dominated by 

C > 0 



teacher K* if either 

1) A/C > 0 and Y(l) > 1 

2) A/C < 0 and Y(l) < 0 



3*J 



C < 0 



3 ) C = 0 and 

a) -A < 0 

b) -A = 0 



and 



B/A < 1 



and -B <0 

^ . Results 

Table IX presents a summary of the dominance tests. 

T ' , V,„, V 0 „, and V_„ are defined above, AD and CD are results 

i\ li\ ji\ 

of absolute and complete dominance. A one indicates that a 
teacher is dominated and a zero indicates a teacher is not 
dominated and has not been eliminated. 

After screening for absolute dominance only teachers 
out of 279 remained in contention, and the complete dominance 
reduced this number to two. 

G. COMPARISONS 

7 

A Fortran program called "COMPARISON" compares the scores 
of the Ith teacher against that of the Jth teacher with the 
constraint that each of these teachers is known by a given 
voter. The study compared the twenty teachers with the highest 
score from "SCORSORT" with each other. 

The final score for each paired comparison was based only 
on the sub-population of voters that identified both teachers. 
The teacher ranked first in "SCORSORT" would be expected to 
win over all other teachers, and the teacher ranked last 
would be expected to lose to all other. If the first teacher 



^A listing of COMPARISON" is included in Appendix B. 
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2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

3 ^ 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 



CD 

0 

0 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

JL. 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 



TABLE IX . DOMINANCE TEST RESULTS 



V 1 K 


v 

2 K 


v 

3 K 


AD 


0.333 


0.216 


0.157 


0 


0.397 


0.052 


0.086 


0 


0.310 


0.207 


0.103 


1 


0.294 


0.162 


0.074 


1 


0.250 


0.191 


0.118 


1 


0.278 


0.120 


0.120 


1 


0.275 


0.145 


0.04 3 


1 


0.229 


0.152 


0.133 


1 


0.211 


0.181 


0.105 


1 


0.198 


0.190 


0.091 


1 


0.189 


0.162 


0.162 


0 


0.284 


0.027 


0.054 


1 


0.171 


0.171 


0.146 


1 


0.217 


0.087 


0.087 


1 


0.189 


0.142 


0.075 


1 


0.214 


0.107 


0.036 


1 


0.182 


0.152 


0.076 


1 


0.176 


0.147 


0.088 


1 


0.176 


0.118 


0.118 


1 


0.173 


0.115 


0.135 


1 


0.218 


0 . 077 


0.026 


1 


0.169 


0.108 


0.108 


1 


0.185 


0.111 


0.037 


1 


0.123 


0.211 


0.035 


• 1 


0.115 


0.184 


0.080 


1 


0.196 


0.020 


0.078 


1 


0.164 


0.086 


0.069 


1 


0.128 


0.151 


0.081 


1 


0.152 


0.109 


O . O65 


1 


0.133 


0.111 


0.133 


1 


0. 165 


0.075 


0.075 


1 


0.190 


0.038 


0.038 


1 


0.152 


0.061 


0.136 


1 


0.129 


0.129 


0.075 


1 


0.154 


0.077 


0.062 


1 


0.136 


0.089 


0.102 


1 


0.144 


0.077 


0.087 


1 


0.117 


0.117 


0.117 


1 


0.132 


0.113 


0.057 


1 


0.109 


0.109 


0.145 


1 


0.099 


0.140 


0.091 


1 


0.125 


0.102 


0.055 


1 


0.107 


0.143 


0.036 


1 


0.138 


0.069 


0.052 


1 


0.133 


0.067 


0.067 


1 


0.068 


0.149 


0.162 


0 


0.123 


0.068 


0.082 


1 


0.141 


0.014 


0.042 


1 


0.097 


O . O87 


0.049 


1 


0.070 


0.132 


0.062 


1 
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were to lose in any of the tests then significant argument 
might be made for giving the award to another of the high 
ranking teachers. 

The results of the paired comparison analysis for the top 
twenty teachers were computed; however, since the teachers 
who were found to be dominant, violated the constraint that 
they have some voters in common, the results did not enter 
into the final selection process. 
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V. THE SELECTION 



Once all the results were obtained, a set of statistics 
was prepared and presented to this years selection committee. 
This presentation included: 

1. Statistics on the voting population 

2. Printed results of all computer programs 

3. Results of dominance tests 

4. An abstract of comments from all ballots in which 
the individuals passing the dominance tests had been 
identified . 

Following the above presentation, the committee voted unani- 
mously for teacher number one. 

The winners name was forwarded to the Academic Dean and 
Superintendent and will be made public at the June graduation 
ceremonies . 

The names of individual teachers concerned were unknown 
to the selection committee throughout the process. At the 
time the above ballot results were revealed, the only name 
announced was that of the winner, which will continue to 
remain secret until announced at the graduation ceremonies. 
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VI. RECOMMENDATIONS 



As was noted in table I, alumni and faculty show an 
increase in the percentage of voters over the previous years. 
Some possible causes for the decrease in students response 
might be attributed to 

1. The timing of the distribution of the ballots was such 
that the voting extended over an exam period. 

2. The long response time given to students may have caused 
students to put off responding, thus, causing them to 
forget about responding altogether. 

3. It was possible this year due to a special letter which 
was attached to the alumni ballot to correct ballots 
which were labeled as students, but definitely from an 
alumnus to be corrected. This problem of alumni still 
identifying as students is obviously a reoccurring 
problem and a more meaningful statistic would be a 
comparison of alumni and students together. However, 
this figure also showed a decrease in response. 

Next years committee should consider shortening the response 
time, avoiding exam periods, and redesigning Part A of the 
ballot so as to eliminate common errors made in voter statistics 



A. REVISION OP PART A 

The problem of ballots with no voter category was eliminated 
this year primarily because the ballots for different groups 
were printed at different times. With the small changes which 
were made it was possible in many cases to identify voter 
category even if it were left blank. However, the problems of 
blank voter category is one which still must be solved. The 
possible causes listed here are: 
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1. The instructions concerning the voter category were 
vague and misinterpreted. 

2. Voter did not want to take time to fill out Part A. 

3. The voter did not want to be identified. 

Of the above, the most likely explanation concerns the 
instruction sheet. The reference to Part A was given in 
step 1. The instructions given in Part A proved to be 
inadequate. Major mistakes were 

1. Student / Alumnus / Faculty / Curricular Officer 
Section — circled wrong choice. This could be 
eliminated by having instructions which state: 

YOU ARE PRESENTLY A (CIRCLE ONE) 

S Student 
A Alumnus 
F Faculty Member 
C Cirricular Officer 

2. Rank — In many cases this was circled to indicate 
branch of service. (01 was circled because it w as 
to the left of N Navy). This accounts for the large 
number of ensigns which were recorded as having voted. 
Instructions such as: 

(Military only circle your present rank) 

01 02 03 04 05 06 07 

should eliminate this problem area. 

3. A common problem was that civilian students were 
confused as to what area to circle. Most of them used 
the area meant for faculty because it was labeled 
civilian. A possible solution would be relabeling and 
adding a voter category of civilian under branch of 
service . 

Part A would thus look like this if all my suggestions 
were incorporated: 

A1 - (All) You are presently a (Encircle one) 

S Student 
A Alumnus 
F Faculty member 
C Curricular Officer 



A2 - (Military Only) Your present rank is: (Encircle one) 

01 02 03 04 05 06 07 

A3 - (All) (Encircle code at left) 



Students/ Alumni/ Curricular Officers 
Branch of Service Curricular Area 



c 


Civilian 


30 


Ops Analysis 


N 


Navy 


31 


Aero Eng 


M 


Marine Corps 


32 


Elec & Comm Eng 


C 


Coast Guard 


33 


Ordnance 


A 


Army 


34 


Naval. Eng 


L 


Air Force 


35 


Env Sci 


F 


Foreign 


36 


Mange & Compt Sci 






37 


Eng Sci 






38 


Baccalaureate 
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Def Management 




Faculty 




Position 


Department 


IR 


Instructor 


AE 


Aeronautics 


AT 


Assist Prof 


AO 


Aviation Safety 


AC 


Assoc Prof 


MN 


Bus Ad & Econ 


PR 


Professor 


EE 


Ele Eng 






GH 


Govt & Human 






MC 


Mat Sc & Chem 






MA 


Math 






ME 


Mech Eng 






MR 


Meteorology 






OC 


Oceanography 






OA 


Ops Analysis 






PH 


Physics 






NS 


Navy Mange Sys Center 



B. COMMITTEE RECOMMENDATION 

This years committee has recommended that in the future 
alumni from the selected year also include U. S. Marines, 
Coast Guard, Air Force, and Foreign Officer graduates. 
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VII . FURTHER ANALYSIS 



With three years of data to work with some questions 
concerning the ranking of teachers could be examined. 

1. Do students and alumni tend to rank teachers similarly? 

2. Does the ranking of teachers by students remain fairly 
constant from year to year? 

These questions are addressed is subsection A. 

A. CONCORDANCE ESTIMATION 

g 

Using Kendall's coefficient of concordance, the degree 
of resemblance between two sets of data can be determined. 

If the coefficient is close to one the two data sets show 
similar rankings. The further the coefficient is from one 
and the closer it is to zero the less the two sets resemble 
each other. Thus, this test can be used to determine if a 
teacher which is ranked high by student voters would also be 
ranked high by alumni. 

Table X is a 2 x 175 matrix of the rankings of teachers 
which were known by at least 10 voters from each group. The 
first row is the ranking of the teachers by the alumni and 
the second row represents the ranking by the students. 

Kendall defines the relationship as 

W = 12(S) 

m 2 (n 3 -n) - 12mT 



8 Kendall , M. 
9^-100, Griffin, 



G., Rank Correlation Methods, 
1955. 



2d e. 



p. 3--H, 
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where W is the coefficient of concordance, m is the number 

of raters, n is the number of rankings, S is the total sum 

n - 

of squares of actual deviations, T = ±-i^± ~ t^), and 4 

indicates number of ties of length i. 

A computer program was written which computed all values 
from the table. Its results indicated that 

12 (1368609) 

w = — — = .7690 

((2) 2 ((175) 3 - 175))) - (12 * 2 * 3394) 

' 9 

The significance of W may be tested using Fisher’s Z, 

letting Z = 1/2 log e - ^i- ' y ~ = *6013- The appropriate degrees 

of freedom for consulting the Z table, are 

v i ■ t"- 1 ’ - h 173 

V 2 •= (m-1) * V 1 = 173 

and the appropriate value of Z in the table is .125 for the 
5$ level of significance. Since the calculated value of 
Z = .6013 is greater than the tabulated test value, V/ is 
therefore significantly different from zero. This indicates 
that we can reject the hypothesis that the rankings by the 
students are unrelated to those of the alumni. A teacher who 
is ranked high by students will also tend to be ranked high 
by alumni. 



^Fisher, R. A. and Yates, F. , Statistical Tables, p. 50, 
Hafner, 1957. 
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A second study was conducted to determine if rankings 
of the faculty were stable across three different voting 
populations. All teachers which were eligible to receive 
the Award for Excellence in Teaching and were known by at 
least ten students in 1970 , 1971 , and 1972 voting were ranked 
by the students from each year. 

Table XI is a 3 x 105 matrix of the rankings of each 
teacher. The first through third rows, are the rankings of 
students from 1970 , 1971 , and 1972 respectively. 

Again using the coefficient of concordance and the new 
computer program the results indicated that 

12 (500957.4) 

W = 5 => = .577058 

(3) ( ( 105 ) J - 105) (12 * 3 * 6 ) 

and Z = 1/2 log e = .2967 

The appropriate degrees of freedom for Z are 
V 1 = (n-1 ) - | = 104.3 

V 2 = (m- 1 ) • V 1 = 208.7 

and the appropriate value of Z in the table is .136 for the 
5 # level of significance. 

Since the calculated value of Z = .297 is greater than 
the test value, W is significantly different from zero. This 
again indicates that the rankings of teachers was not random 
and that a teacher's ranking was stable across years. 



TABLE X. CONCORDANCE MATRIX 1 



Alumni 


1.0 


2.0 


3-0 


4.5 


6.0 


7.0 


Student 


31.0 


32.0 


66.0 


26.0 


23.0 


38.0 


Total 


J27T) 


IT. IT 


-T07O 


"3^33 


27.5 


44 . 0 


Alumni 


9.0 


10.0 


11.0 


12.0 


13.0 


14.0 


Student 


13.0 


24.0 


48.0 


29.0 


19.0 


122.0 


Total 


22.0 


34 . 0 


59.0 


41.0 


32.0 


136.0 


Alumni 


15.0 


16.0 


17.0 


19 • 0 


19.0 


19.0 


Student 


145.0 


-9.-0 


10.0 


. 2.0 


84.0 


102.0 


Total 


160.0 


25.0 


27.0 


21.0 


103.0 


121.0 


Alumni 


21.0 


22.0 


23.0 


24 . 0 


25.0 


26.5 


Student 


63.0 


1.0 


21.0 


107.0 


136.5 


70.0 


Total 


84.0 


23-0 


44 . 0 


133.0 


161.5 


96.5 


Alumni 


28.0 


29.0 


30.0 


31.0 


32.0 


33.0 


Student 


79-0 


82.5 


86.0 


57.0 


8.0 


146.0 


Total 


107.0 


111,5 


116.0 


88.0 


40.0 


179.0 


Alumni 


34 . 0 


35.0 


36.0 


37.0 


38.0 


39.0 


Student 


6.0 


68.5 


' — 95-,-Q 


51.0 


152.0 


141.0 


Total 


40.0 


103.5 


131.0 


88.0 


190.0 


180.0 


Alumni 


40.0 


41.5 


41.5 


43.0 


44.0 


45.0 


Student 


17.0 


73-0 


46.0 


99 - 9 . 


5-0 


32.0 


Total 


57.0 


114.5 


87.5 


142.5 


49.0 


79.0 


Alumni 


46.0 


47.0 


48.0 


49.0 


50.5 


50.5 


Student 


20.0 


114.0 


91.0 


22.0 


54 . 0 


78.0 


Total 


66.0 


161.0 


139.0 


71.0 


104.5 


128.5 


Alumni 


52.0 


53.0 


54.5 


54.5 


56.0 


57.0 


Student 


132.0 


28.0 


52.0 


128.5 


104 . 0 


.50.^0 


Total 


184.0 


81.0 


106.5 


183.0 


160.0 


107.0 


Alumni 


58.0 


59-0 


61.0 


61.0 


61.0 


63.0 


Student 


58.0 


71.0 


.. .59. J) 


68.5 


7.0 


11.0 


Total 


116.0 


130.0 


120.0 


129.5 


68.0 


74 . 0 
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TABLE X. 


CONCORDANCE 


; MATRIX 


1 (Continued) 




Alumni 


64.0 


65.0 


66.5 


66.5 


68.0 


69.0 


Student 


53-0 


97.0 


35.0 


76.5 


15.0 


123.5 


Total 


Tlf.O 


162.0 


101/5 


TUTTff 


83.0 


T9775 


Alumni 


70.0 


71.0 


73.0 


73.0 


73.0 


75.0 


Student 


61.0 


117.0 


14 7. 0 


30.0 


12.0 


89.O 


Total 


T31. 0 


188.0 


220.0 


103.0 


“8570 


IMTo 


Alumni 


77.0 


77.0 


77.0 


79.5 


79.5 


81.0 


Student 


81.0 


39.0 


33-0 


•94.0 


42.5 


138.0 


Total 


158". 0 


116.0 


80.0 


173.5 


122.0 


219.0 


Alumni 


82.5 


82.5 


84 . 5 


84 . 5 


86.5 


86.5 


Student 


76.5 


18.0 


74 . 0 


90.0 


103.0 


55-0 


Total 


159-0 


100.0 


158.5 


174.5 


189 . 5 


14 1 . 5 


Alumni 


88.0 


89.O 


90.5 


90.5 


92.0 


93.0 


Student 


108.0 


110.0 


156.5 


164 . 5 


116 . 0 


148.0 


Total 


196.0 


199*0 


227 . 0 


255.0 


O 

oo 

0 

OJ 


241. 0 


Alumni 


94 . 0 


95.0 


96.5 


96.5 


98.5 


98.5 


Student 


14 . 0 


42.5 


120.0 


99.5 


85.0 


45.0 


Total 


108.0 


127.5 


217.5 


196.0 


183 .“5 


1*13.5 


Alumni 


100.0 


101.0 


102.0 


103. 0 


104 . 0 


105.0 


Student 


164.5 


41.0 


88.0 


66.0 


164 . 4 


134 . 0 


Total 


264 . 5 


142.0 


190.0 


169.0 


268.5 


239.0 


Alumni 


106.0 


107.5 


107.5 


109.5 


109.5 


111.0 


Student 


87.0 


164 . 5 


16.0 


49.0 


47 . 0 


105-0 


Total 


193.0 


272.0 


123.5 


158.5 


156.5 


216.5 


Alumni 


112.5 


112.5 


114.0 


115.0 


116.0 


117.0 


Student 


101.0 


92.0 


127.0 


36.0 


111.0 


112.0 


Total 


213.5 


204.5 


O 

1 — 1 
C\J 


151.0 


227.0 


229'. 0 


Alumni 


118.0 


119.0 


120.5 


120.5 


122.0 


123.0 


Student 


164 . 5 


128.5 


37.0 


96.0 


56.0 


133.0 


Total 


282.5 


247.5 


157.5 


216.5 


178.0 


256.0 



TABLE X. CONCORDANCE MATRIX 1 (concluded) 



Alumni 


124.5 


124.5 


126.0 


128.0 


128.0 


128.0 


Student 


98.0 


44.0 


164.5 


27 . 0 


14.3. 5. 


60.0 


Total 


222.5 


168.5 


290.5 


155.0 


271.5 


188.0 


Alumni 


131.0 


132.5 


132.5 


134 . 0 


135.0 


136.0 


Student 


150.0 


164.6 


-139.5 


12 3. ._5. 


33.0 


72.0 


Total 


281.0 


297.0 


272.0 


257.5 


168.0 


208.0 


Alumni 


137.5 


137.5 


139.0 


130.0 


141.0 


142.0 


Student 


142.0 


164 . 5 


66.0 


164.5 


119.0 


164 .4 



Total 


279.5 


302.0 


205.0 


304.5 


260.0 


306.5 


Alumni 

Student 

Total 


143.0 
75.0 

218.0 


144.0 

liQoIL 

274 . 0 


160.0 

164.5 

324.5 


160.0 

153 . 0 

313.0 


160.0 

109.0 

269.0 


160.0 

135.0 

295.0 


Alumni 

Student 


160.0 


160.0 
15.1 .-Q 


160 . 0 

121.0 


160.0 

118.0 


160.0 
164 .5 


160. 0 
82.5 


Total 


286.0 


311.0 


281.0 


278.0 


324.5 


242.5 


Alumni 

Student 

Total 


160.0 

164 . 5 

324.5 


160.0 

164 . 5 

324.5 


160.0 

113.0 

273-0 


160.0 

62.0 

222.0 


160.0 
40 . 0 
200.0 


160.0 

164 . 5 

324.5 


Alumni 

Student 

Total 


160.0 

139.5 

299.5 


160. 0 
80.0 
240.0 


160.0 

93.0 

253-0 


160.0 

149.0 

309.0 


160.0 

164 . 5 

324.5 


160.0 

164 . 5 

324.5 


Alumni 

Student 

Total 


160.0 

125.0 

285.0 


160.0 
64 . 0 
224 . 0 


160.0 

105.5 

265.5 


160.0 

131.0 

291.0 


160.0 

164 . 5 

324.5 


160.0 

164 . 5 

324.5 


Alumni 

Student 

Total 


160.0 

164.5 

324.5 


160.0 

164 . 5 

324.5 


160.0 

164 . 5 

324.5 









[vjl O VJl|VJl o o 



TABLE XI. CONCORDANCE MATRIX 2 



Students 


' 72 


1.0 


2.0 


3.0 


4.0 


5.0 


6.0 


Students 


’71 


36.0 


39.0 


31.0 


7.0 


95.0 


20.0 


Students 


'70 


1.0 


18.0 


2.0 


8.0 


7.0 


25.0 


Total 




- 3 BT 0 


59.0 


36. 0 


19.0 


107.0 


51.0 


Students 


' 72 


7.0 


8.0 


9.0 


10.0 


11.0 


12.0 


Students 


'71 


44.0 


84 . 0 


6.0 


4.0 


47.0 


30.0 


Students 


'70 


13.0 


l4.o 


34.5 


10.0 


23.0 


40.0 


Total 




64.0 


106.0 


*19. 5 


O 

C\J 


Bl.O 


82.0 


Students 


'72 


13.0 


14 . 0 


15.0 


16.0 


17.0 


18.0 


Students 


’71 


16.5 


19.0 


83 .O 


2.0 


33.0 


38.0 


Students 


' 70 


36.0 


5.0 


22.0 


15.0 


57-0 


16.0 


Total 




"65.5 


"3^70 


120.0 


33.0 


107.0 


72.0 


Students 


' 72 


19.0 


20.0 


21.0 


22.0 


23.0 


24.0 


Students 


’71 


51.0 


101.0 


57-0 


72.0 


13.0 


29.0 


Student s 


'70 


28.0 


45.0 


33-0 


11.0 


34.5 


12.0 


Total 




98.0 


lF5T0 


121.0 


105.0 


70.5 


65.0 


Students 


' 72 


25.0 


26.0 


27.0 


28.0 


29.0 


30.0 


Student s 


'71 


60.0 


24.0 


48.0 


80.0 


18.0 


76.0 


Students 


' 70 


17.0 


.27.0 


55.0 


19.0 


44.0 


24 . 0 


Total 




102.0 


77.0 


130.0 


127.0 


91.0 


130.0 


Students 


. 7 2 


31.0 


32.0 


33.5 


33.5 


35.0 


36.0 


Students 


'71 


66.0 


52.5 


21.0 


12.0 


8.0 


82.0 


Students 


'70 


102.0 


37-0 


26.0 


71.5 


58.0 


41.0 


Total 




199.0 


121.5 


80.5 


117.0 


101.0 


159.0 


Students 


' 72 


37.0 


38.0 


39.0 


40.0 


41.0 


42.0 


Students 


'71 


92.0 


71.0 


40.5 


84.5 


56.0 


10.0 


Students 


' 70 


52.0 


39.0 


6.0 


29.0 


93.5 


69.0 


Total 




181.0 


148. "0 


85.5 


153.5 


190.5 


121.0 


Students 


'72 


43.0 


44 . 0 


45.0 


46.0 


47.0 


48.0 


Students 


'71 


97.0 


90.0 


67.5 


32.0 


63.0 


74.0 


Students 


'70 


50.0 


85.0 


65.0 


78.0 


61.0 


98.5 


Total 




190.0 


219.0 


177-5 


156.0 


171.0 


220.5 


Students 


' 72' 


49.0 


50.0 


51.0 


52.0 


53.0 


54 . 0 


Student s 


’71 


73.0 


5.0 


89 .O 


75.0 


26.0 


49.0 


Students 


' 70 


77.0 


42.0 


91.0 


20.0 


100.0 


101.0 


Total 




199.0 


97.0 


231.0 


l'4'7T0 


179.0 


2o4To 
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TABLE XI. CONCORDANCE MATRIX 2 (Continued 



Students 


'72 


55.0 


56.0 


Students 


'71 


54.0 


46.0 


Student s 


'70 


63.0 


38.0 


Total 




172.0 


l4o. 0 


Students 


’72 


61.0 


62.0 


Students 


*71 


61.0 


27.0 


Students 


*70 


103.0 


30.0 


Total 




225.0 


119.0 


Students 


'72 


67.0 


68.5 


Students 


'71 


64.0 


69 . 0 


Students 


*70 


54.0 


92.0 


Total 




185.0 


229-5 


Students 


'72 


73.0 


74.0 


Students 


’71 


1.0 


100.0 


Students 


'70 


96.0 


82.0 


Total 




170.0 


256.0 


Students 


’ 72 


79.0 


80.0 


Students 


'71 


103.5 


52.3 


Students 


'70 


83.0 


51.0 


Total 




265.5 


183 '. 5 


Students 


'72 


85.0 


86.0 


Students 


'71 


28.0 


67.0 


Students 


'70 


46.0 


75.0 


Total 




159.0 


228.0 



Students 


' 72 


91.0 


92.0 


Students 


’71 


105.0 


91.0 


Student s 


'70 


71.5 


66.0 


Total 




267.5 


249.0 


Students 


' 72 


97.0 


98.0 


Students 


'71 


77.0 


94.0 


Students 


'70 


59.0 


105.0 


Total 




233.0 


297-0 



Students 


* 72 


103.0 


104.0 


Students 


’71 


40.5 


78.0 


Students 


'70 


21.5 


88.0 


Total 




164 . 5 


270.0 



57.0 


58.0 


59.0 


60.0 


34.0 


15.0 


99.0 


9.0 


76.0 


53-0 


62.0 


81.0 


167.0 


126.0 


220.0 


150.0 


63.0 


64.0 


65.0 


66.0 


58.0 


93-0 


25.0 


35.0 


31.0 


3.0 


70.0 


32.0 


152.0 


160.0 


160.0 


133.0 


68.5. 


70.0 


71.0 


72.0 


43.0 


50. 0 


96.0 


65.O 


98.5 


80.0 


60.0 


68.0 


210.0 


200.0 


227.0 


185.0 


75.0 


76.0 


77.0 


78.0 


11.0 


98.0 


86.0 


22.0 


49.0 


48.0 


86.0 


79.0 


135.0 


222.0 


249.0 


179.0 


81.0 


82.0 


83.0 


84.0 


103.5 


70.0 


23.0 


45.0 


97.0 


64.0 


95.0 


67.0 


28X75 


216.0" 


201.0 


196.0 


87.0 


88.0 


89.0 


90.0 


16.5 


37.0 


88.0 


59.0 


9.0 


47.0 


74.0 


93.5 


112.5 


172.0 


251.0 


242.5 


93.0 


94.0 


95.0 


96.0 


34.0 


55.0 


42.0 


62 . 0 


43.0 


89.0 


73-0 


90.0 


150.0 


238.6 


210.0 


248.0 


99.0 


100.0 


101.0 


102.0 


81.0 


87.0 


79-0 


3.0 


84.0 


87.0 


56.0 


4.0 


264 ".' 0 


O 

£ — 
00 


236.0 


109.0 


105.0 








102.0 








104 . 0 









311.0 
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APPENDIX A 



THE REAR ADMIRAL JOHN J. SHISFFELIN AWARD 
FOR EXCELLENCE IN TEACHING 



In order to augment the existing incentives for teaching of high 
quality, an award for Excellence in Teaching has been established by 
the Superintendent. A substantial stipend was made possible through 
a gift to the Naval Postgraduate School Foundation in honor of Rear 
Admiral John J. Shieffelin, USIT. The judgments of those who have 
participated in the educational processes at the Naval Postgraduate 
School are of primary importance in determining the recipient. This 
poll is being conducted to assess the collective opinion of students, 
faculty, staff, and selected alumni. Alter accumulating and processing 
the voting results , the Selection Committee will recommend an Awardee 
to the Superintendent. 

A meaningful selection of the Award receipient is heavily dependent 
upon input from a large portion of the eligible voters . Your response 
is therefore earnestly requested. Please complete the enclosed 
ballot in accordance with the instructions below. The results of the 
polling, other than the name of the Award recipient, will be treated 
as privileged information. 

BALLOTING PROCEDURE: 



Step 1. Complete the information requested at the top (Part A) of the 
ballot. These items are for purposes of statistical analyses 
only. 

Step 2. On the list of eligible faculty (Part C), encircle the 

four -digit identification number at the left of all those 
with whom you are sufficiently acquainted to make a judgment. 
For purposes of establishing a valid population base, it 
is important to encircle a].] with whom you are acquainted . 

If you have circled five cr rn^re numbers on the ballot, proceed 
to Step 3 - Otherwise, please return your ballot as directed 
in Step 5- 



Step 3- From the subset of faculty you have indicated in Step 2, 
select from one (l) to three (3) nominees. Indicate your 
preferences in order by rlacin.m the four -dixit identification 
numbers of ycur nc m'r.eec fer f:‘rs~. sec era and third choices 
in the appropriate spaces provided in Part B . 

Step 4. You are invited to furnish a short statement in support of 

your primary nomination. Indicate those qualities which, in 
your judgment, make him an outstnading teacher. Space is 
provided for this at the end (Part D) of the ballot. 



Step 5* Place your completed ballot in the enclosed return envelope, 
sign the envelope and return. Te .v counted ballots must be 
received by 15 A~ril 1°72. BO ? “t ~ vi?'i be separated from 
the envelopes . 
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BALLOT 



Part A - Statistical (encircle code at left) 

Voter Category 



S Student 
A Alumnus 



F Faculty 

C Curricular Officer 





Military 








Civilian 






Rank 


Branch of Service 


Curricular Area 


Rank 


Department 


01 


N Navy 


30 


Ops Analysis 


IR 


Instructor 


AE 


Aeronautics 


02 


M Marine Corps 


31 


Aero Eng 


AT 


Assist Prof 


AO 


Aviation Safety 


03 


A Army 


32 


Elec & Comm Eng 


AC 


Assoc Prof 


m 


Bus Ad & Econ 


o4 


C Coast Guard 


33 


Ordnance 


RP 


Professor 


EE 


Elec Eng 


05 


L Air Force 


34 


Naval Eng 






GH 


Govt & Humanities 


06 


F Foreign 


35 


Env Sci 






MC 


Mat Sc & Chem 


07 




36 


Mange & Compt Sci 






MA 


Math 






37 


Eng Sci 






ME 


Mech Eng 






38 


Baccalaureate 






MR 


Meteorology 






39 


Def Management 






OC 


Oceanography 














OA 


Ops Analysis 




- Nominations (use 




four -digit identification number) 






PH 


Physics 


Part B 


the 






NS 


Navy Mange Sys Center 




First Choice 




Second choice 




Third Choice 







Part C - List of Eligible Faculty (i.e., all faculty who taught tvo or more course segments in calendar 

year 1971, except Department Chairmen, Curricular and Liaison Officers, members of the Selection 
Committee and past recipients of the Award. 



Aviation Safety Programs 


1636 


Gardner, E. M. 


1014 


Bomberger, R. B. 


1647 


Geist, J. M. 


1025 


Bradbury, C. M. 


1658 


Gerba, A. , Jr. 


5016 


Branson, J. J. 


1669 


Houston, R.K. 


1047 


Wible , L. C. 


1670 


Kirk, D. E. 


Department of Aeronautics 


1681 


Klamm, C. F. , Jr. 


5027 


Bank, M. H. 


4035 


Knorr, J. B. 


1069 


Bennett, J.A.J. 


1692 


Marmont, G. H. 


1070 


Biblarz, 0. 


5072 


Menneken, C. E. 


1081 


Collins, D. J. 


1708 


Miller, R. L. 


5038 


Fuhs, A. E. 


1720 


>fyers, G. A. 


1092 


Gavain, T. H. 


' 5083 


Myers, H. L. 


1108 


Haupt , U . 


1753 


Panhclzer, R. 


5049 


Hess, R. A. 


4079 


Powers, J. P. 


1119 


Kahr , C. H. 


4080 


Powers, V. M. 


1120 


Layton, D. M. 


5094 


Price, T. G. 


1131 


Lindsey, G. H. 


1764 


Rahe, G. A. 


1142 


Miller, J. A. 


1775 


Rothauge, C. H. 


1153 


Ketzer, D. W. 


1786 


Sackman, G. L. 


1164 


Platzer, M. F. 


1797 


She ingold, A. 


5050 


Power, H. L. 


1803 


Smith, W. C. 


1175 


Redlin, M. H. 


1814 


Spaugy, D. A. 


1186 


Schmidt, L. V. 


1825 


Stentz, D. A. 


1203 


Zucker, R. D. 


1836 


Strum, R. D. 


Department of Electrical 


1847 


Terman, F. W. 


Engineering 


1858 


Thaler, G. J. 


1 U 81 


Adler, R. W. 


1869 


Titus, H. A. 


5061 


Bach, R. 


1870 


Turner, J. B. , Jr. 


1508 


Bauer, W. M. 


1881 


Ward, J. R. 


1519 


Baycura, 0. M. 


1892 


Wilcox, M. L. 


1531 


Bouldry, John M. 


Department of Government 


15 U 2 


Breida, S. 


and Humanities 


1553 


Campbell, J. D. 


1919 


Amos, J. W«, II 


156 U 


Chan , S . 


1931 


Boggess, W. C. 


1575 


Chaney, J. G. 


5100 


Caldwell, D. E. 


1586 


Cooper, P. E. 


1942 


Gabel, B. B. 


1597 


Cotton, M. L. 


1953 


Gottschalk, S. 


1603 


DeLaura, R. D. 


1964 


McAdams, J.M. 



1625 Ewing, Gerald D. 



1986 


Pearson, L. W. 


2323 


Kodres, U. R. 


1997 


Smith, B. M. L. 


2334 


Kolitz, B. L. 


2017 


Teti, F. M. 


5166 


Kovach, L. D. 


Department of Material 


2367 


Lucas, K. R. 


Science & Chemistry 


2378 


Marks, H. B. 


2028 


Clark, J. R. 


2378 


Morris, G. W. 


5111 


Edwards, G. R. 










2390 


Pierce, J. P. 


2040 


Bering, C. A. 


2417 


Pulliam, F. M. 


2062 


Leonesio, R. B. 










3971 


Ramanujara, H. R. 


2051 


Kinney, G. F. 


5177 


Rice, B. 


2073 


Reinhardt, R. A 


2428 


Roberts, A. B. 


2084 


Reynolds, M. F. 


2439 


Schoenstadt, A. L. 


2095 


Rowell, C. F. 


2451 


Shorb, A. M. 


5122 


Schultz, J. W. 


2462 


Singer, E. A. 


2101 


Sinclair, J. E. 


5188 


Singer S. 


2112 


Tolies, W. M. 


2473 


Spalding, J. H. 


2123 


Wilson, J. W. 


2484 


Stewart, E. J. 


Department of Mathematics 


2495 


Stoops, G. A. 


5133 


Ault, D. A. 


2501 


Syms, G. H. 


2134 


Bender, A. P. 


2512 


Trahan, D. H. 


2145 


Bleick, W. E. 


2523 


Wang, P. C. C. 


2156 


Bolles, R. C. 


2534 


Weir, M. D. 


5144 


Brubaker, R. H. 


2545 


Wilde, C. 0. 


2167 


Budvay, J. J. 


Department of Mechanical 


2189 


Chewning, W. C. 


Engineering 


2190 


Comstock, C. 


2552 


Brock, J. E. 


2206 


Davis D . L. 


2567 


Cantin, G. 


2217 


Dixon, D. R. 


2578 


Cooper, T. E. 


4057 


Draper, R. A. 


2589 


Garrison, C. J. 


2228 


Estell, R. J. 


2590 


Houlihan, T. M. 


5155 


Evans, R. M. 


2606 


Kelleher, M. D. 


2239 


Faulkner, F. D. 


2617 


Mar to, P. J. 


2240 


Franke, R. 


2628 


Newton, R. E. 


2251 


Giarratana, J. 


2639 


Nguyen, D. H. 


2262 


Gibbons, G. D. 


2640 


Prowell, P. W. 


4091 


Hanna, R. M. 


5199 


Pucci, P. F . 


2295 


Jayachandran, T. 


2651 


Salinas, D. 


2301 


Jennings, W. 


5200 


Sarpkaya, T. 


2312 


Kildall, G. A. 


2662 


Winfrey, R. C. 
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D epartment of Meteorology 



2673 


Albertv, R. L. 


2684 


Davidson, K. L. 


2712 


Elsberry, R. L. 


2723 


Hamilton, H. D. 


5211 


Haney, R. L. 


2745 


Martin, F. L. 


2756 


Oakes, W. B. 


2767 


Schardt , D . L . 


2778 


Taylor, C. L. 


2789 


Van der Biljl, W. 


7001 


Williams, R. T. 


3915 


Winninghoff, F. J. 


Department of Oceanography 


2806 


Andrews, R. S. 


2817 


Bassett , C . H. 


2828 


Boston, N.E.J. 


5222 


Bourke , R. H. 


2840 


Denner, W. U T . 


2851 


Galt, J. A. 


2895 


Jung, G. H. 


5233 


Knodle , W. C. 


5244 


Roberts, C. K. 


2912 


Thompson, W. C. 


2923 


Thornton, E. B. 


29 34 


Traganza, E. D. 


2956 


von Schwind , J . J . 


2967 


Wickham, J. B. 


Department of Operations 
Research and Administrative 


C ci or 


cos 



29 78 Andrus * A. F. 

2989 Arima, J. K. 

0066 Barden, R. S. 

2990 Barr, D. R. 

0105 Bedow, R. J. 

3010 Brill , E. A. 

3021 But tervorth , R. W. 
3032 Burnett, T. D. 

3043 Capra, J. R. 

1214 Carrick, P. M. 



1225 Church, W. H. 

0077 Courtney, D. 

4013 Creighton, J. W. 
3054 Cunningham, W. P. 
1247 Darbyshire, L. 
1258 Eisenhardt, P. 
1269 Els ter , R. S. 

3076 Esary, J. D. 

3098 Floyd, J. A. 

3115 Forrest, R. X . 
3104 Free, V. D. 

1220 Fremgen, J, J. 
1281 Canz, C. 

3126 Caver, D. P. 

1292 Githens, W. H. 
1308 Grainger, T. L. 
3148 Greenberg, H. 

4091 Hanna, M. 

0011 Hauser, N . 

3160 Heidorn, G. E. 
3171 Higgins, J. E. 
0088 Horton, F. C. 

1319 Hover land, H. A. 
3182 Howard, G. T. 

1320 Hynes, J . P. 

1331 Jolly, J. A. 

0099 King, G. J. 

3948 Kline, H. B. 

1353 Lande, R. S. 

1364 Lane, H. L. 

3232 Larson, H. J. 

1375 L*e, M. w. 

3243 Lindsay, G. F. 
3265 Marshall, K. T. 
1386 McDonald, J. II . 
3254 McMaslers, A. W. 
3276 Milch, P. R. 

3287 Peterson, C. A. 
3298 Poock, G. K. 

3304 Preston, F. L. 
0116 Raike, W. M. 



39 37 


Read, R. R. 


3315 


Richards, F. R. 


4046 


Schneidewind , N. F 


3326 


Schrady, D. A. 


0127 


Senger, J. D. 


3348 


Shubert, B. 0. 


3359 


Shudde , R. H. 


0138 


Sontheimer, K. 


3360 


Sovereign, M. G. 


1425 


Steckler , M. J. 


3382 


Taylor, J. G. 


0149 


Thomas, M. U. 


3409 


Tysver, J. B. 


3960 


Uhler, R. S. 


3410 


Washburn, A. R. 


0150 


Vassenaar, D. J. 


1458 


Wegener, W. H. 


0161 


Weitzman, R. A. 


0172 


WTiipple, D. 


14 70 


U T ome r , N . K . 


3421 


V. T oods , WL M. 


3432 


Zehna, P. W. 


344 3 


Zweig, H. J. 


Department of Physics 


3454 


Armstead, R. L. 


3465 


Busk irk, F. R. 


3476 


Ceglio , N. M. 


3^o 7 


cooper , A . \ . 


3498 


Cooper, J. L. 


3504 


Coopens, A. B. 


3515 


Crit te iden, E. C . , J: 


3526 


Dahl , H . A. 


0183 


Dally, E. B. 


35 37 


Eller, A. I. 


3548 


Garrettson, G. A. 


3559 


Handler, H. E. 


3560 


Harrison , D . E. , J 


3571 


Kalmbach, S. H. 


3582 


Kelley, R. L. 


3609 


Lipes, R. G. 


3610 


Little, W. 



0194 Maruyama, X. K. 

3621 Medwin, H. 

36 32 Milne, E. A. 

3643 Neighbours, J. R. 

3654 Olsen, L. 0. 

3665 Reese, W. 

3676 Riggin, J. D. 

3687 Rodeback, G. W. 

3698 Sanders, J. V. 

3704 Schacher, G. E. 

3715 Schwirzke, F. R. 

3726 Williamson, T. J. 

7012 Wilson, 0. B. , Jr. 

3737 Woehler, K. E. 

3748 Zeleny, W. B. 

Navy Management Systems 
Center 

3759 Blandin, Sherman W. 

3760 Boynton, R. E. 

0200 Callahan, J. F. 

0211 Campbell, W. A. 

3782 Childs, F. E. 

3793 Dawson, J. E. 

3809 DeSerpa, A. C. 

3810 Doran, E. J. 

3821 Freed, E. J. 

3854 Mauer, W. A. 

3865 Plotkin , N. 

3876 Puscheck, 11. C. 

3898 Ulrey, I. W. 

3887 von Pagenhardt, R. 
3904 Wood, C. L. 



Part D - Supporting remarks for your primary nomination (optional) 
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